Dataset statistics
| Number of variables | 18 |
|---|---|
| Number of observations | 60000 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 7 |
| Duplicate rows (%) | < 0.1% |
| Total size in memory | 8.2 MiB |
| Average record size in memory | 144.0 B |
Variable types
| Categorical | 6 |
|---|---|
| Numeric | 11 |
| Boolean | 1 |
| Dataset has 7 (< 0.1%) duplicate rows | Duplicates |
trip_distance is highly overall correlated with fare_amount and 2 other fields | High correlation |
ratecodeid is highly overall correlated with tolls_amount | High correlation |
fare_amount is highly overall correlated with trip_distance and 2 other fields | High correlation |
extra is highly overall correlated with vendorid | High correlation |
tip_amount is highly overall correlated with total_amount | High correlation |
tolls_amount is highly overall correlated with ratecodeid | High correlation |
total_amount is highly overall correlated with trip_distance and 3 other fields | High correlation |
duration is highly overall correlated with trip_distance and 2 other fields | High correlation |
vendorid is highly overall correlated with extra | High correlation |
mta_tax is highly overall correlated with improvement_surcharge and 1 other fields | High correlation |
improvement_surcharge is highly overall correlated with mta_tax and 1 other fields | High correlation |
congestion_surcharge is highly overall correlated with mta_tax and 1 other fields | High correlation |
store_and_fwd_flag is highly imbalanced (95.3%) | Imbalance |
payment_type is highly imbalanced (52.6%) | Imbalance |
mta_tax is highly imbalanced (89.0%) | Imbalance |
improvement_surcharge is highly imbalanced (95.1%) | Imbalance |
congestion_surcharge is highly imbalanced (65.2%) | Imbalance |
airport_fee is highly imbalanced (70.7%) | Imbalance |
duration is highly skewed (γ1 = 23.81338668) | Skewed |
passenger_count has 1143 (1.9%) zeros | Zeros |
trip_distance has 1121 (1.9%) zeros | Zeros |
extra has 27569 (45.9%) zeros | Zeros |
tip_amount has 18247 (30.4%) zeros | Zeros |
tolls_amount has 54413 (90.7%) zeros | Zeros |
Reproduction
| Analysis started | 2023-10-29 14:17:36.981957 |
|---|---|
| Analysis finished | 2023-10-29 14:19:14.251201 |
| Duration | 1 minute and 37.27 seconds |
| Software version | pandas-profiling v3.6.6 |
| Download configuration | config.json |
vendorid
Categorical
| Distinct | 2 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 2 | |
|---|---|
| 1 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 60000 |
|---|---|
| Distinct characters | 2 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2 |
|---|---|
| 2nd row | 2 |
| 3rd row | 2 |
| 4th row | 1 |
| 5th row | 2 |
Common Values
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
Most occurring characters
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 60000 |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 60000 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 60000 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 2 | 44804 | |
| 1 | 15196 | 25.3% |
passenger_count
Real number (ℝ)
| Distinct | 7 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.5574167 |
| Minimum | 0 |
|---|---|
| Maximum | 6 |
| Zeros | 1143 |
| Zeros (%) | 1.9% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 1 |
| median | 1 |
| Q3 | 2 |
| 95-th percentile | 4 |
| Maximum | 6 |
| Range | 6 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 1.0276126 |
|---|---|
| Coefficient of variation (CV) | 0.65981865 |
| Kurtosis | 4.2443528 |
| Mean | 1.5574167 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 1.9987009 |
| Sum | 93445 |
| Variance | 1.0559876 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 1 | 38370 | |
| 2 | 12658 | 21.1% |
| 3 | 3746 | 6.2% |
| 4 | 2467 | 4.1% |
| 0 | 1143 | 1.9% |
| 5 | 1043 | 1.7% |
| 6 | 573 | 1.0% |
| Value | Count | Frequency (%) |
| 0 | 1143 | 1.9% |
| 1 | 38370 | |
| 2 | 12658 | 21.1% |
| 3 | 3746 | 6.2% |
| 4 | 2467 | 4.1% |
| 5 | 1043 | 1.7% |
| 6 | 573 | 1.0% |
| Value | Count | Frequency (%) |
| 6 | 573 | 1.0% |
| 5 | 1043 | 1.7% |
| 4 | 2467 | 4.1% |
| 3 | 3746 | 6.2% |
| 2 | 12658 | 21.1% |
| 1 | 38370 | |
| 0 | 1143 | 1.9% |
trip_distance
Real number (ℝ)
HIGH CORRELATION ZEROS
| Distinct | 2405 |
|---|---|
| Distinct (%) | 4.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 4.1211262 |
| Minimum | 0 |
|---|---|
| Maximum | 105.55 |
| Zeros | 1121 |
| Zeros (%) | 1.9% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0.5 |
| Q1 | 1.2 |
| median | 2.2 |
| Q3 | 4.6125 |
| 95-th percentile | 17.3 |
| Maximum | 105.55 |
| Range | 105.55 |
| Interquartile range (IQR) | 3.4125 |
Descriptive statistics
| Standard deviation | 4.9869271 |
|---|---|
| Coefficient of variation (CV) | 1.2100884 |
| Kurtosis | 11.613484 |
| Mean | 4.1211262 |
| Median Absolute Deviation (MAD) | 1.26 |
| Skewness | 2.6013305 |
| Sum | 247267.57 |
| Variance | 24.869442 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 1121 | 1.9% |
| 1 | 659 | 1.1% |
| 1.2 | 641 | 1.1% |
| 0.9 | 639 | 1.1% |
| 1.1 | 619 | 1.0% |
| 1.3 | 615 | 1.0% |
| 0.8 | 605 | 1.0% |
| 1.4 | 601 | 1.0% |
| 1.5 | 539 | 0.9% |
| 1.7 | 538 | 0.9% |
| Other values (2395) | 53423 |
| Value | Count | Frequency (%) |
| 0 | 1121 | |
| 0.01 | 64 | 0.1% |
| 0.02 | 43 | 0.1% |
| 0.03 | 36 | 0.1% |
| 0.04 | 20 | < 0.1% |
| 0.05 | 19 | < 0.1% |
| 0.06 | 26 | < 0.1% |
| 0.07 | 22 | < 0.1% |
| 0.08 | 21 | < 0.1% |
| 0.09 | 15 | < 0.1% |
| Value | Count | Frequency (%) |
| 105.55 | 1 | |
| 82.07 | 2 | |
| 66.42 | 1 | |
| 57.49 | 1 | |
| 56.41 | 1 | |
| 56.2 | 1 | |
| 54.7 | 1 | |
| 53.07 | 1 | |
| 51.4 | 1 | |
| 49.79 | 1 |
ratecodeid
Real number (ℝ)
| Distinct | 7 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.4230667 |
| Minimum | 1 |
|---|---|
| Maximum | 99 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 1 |
| median | 1 |
| Q3 | 1 |
| 95-th percentile | 2 |
| Maximum | 99 |
| Range | 98 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 5.3955105 |
|---|---|
| Coefficient of variation (CV) | 3.7914671 |
| Kurtosis | 319.73057 |
| Mean | 1.4230667 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 17.848017 |
| Sum | 85384 |
| Variance | 29.111533 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 1 | 55324 | |
| 2 | 3095 | 5.2% |
| 5 | 811 | 1.4% |
| 3 | 462 | 0.8% |
| 99 | 181 | 0.3% |
| 4 | 126 | 0.2% |
| 6 | 1 | < 0.1% |
| Value | Count | Frequency (%) |
| 1 | 55324 | |
| 2 | 3095 | 5.2% |
| 3 | 462 | 0.8% |
| 4 | 126 | 0.2% |
| 5 | 811 | 1.4% |
| 6 | 1 | < 0.1% |
| 99 | 181 | 0.3% |
| Value | Count | Frequency (%) |
| 99 | 181 | 0.3% |
| 6 | 1 | < 0.1% |
| 5 | 811 | 1.4% |
| 4 | 126 | 0.2% |
| 3 | 462 | 0.8% |
| 2 | 3095 | 5.2% |
| 1 | 55324 |
store_and_fwd_flag
Boolean
| Distinct | 2 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 58.7 KiB |
| False | |
|---|---|
| True | 312 |
| Value | Count | Frequency (%) |
| False | 59688 | |
| True | 312 | 0.5% |
pulocationid
Real number (ℝ)
| Distinct | 212 |
|---|---|
| Distinct (%) | 0.4% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 159.52992 |
| Minimum | 1 |
|---|---|
| Maximum | 265 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 48 |
| Q1 | 113 |
| median | 161 |
| Q3 | 231 |
| 95-th percentile | 262 |
| Maximum | 265 |
| Range | 264 |
| Interquartile range (IQR) | 118 |
Descriptive statistics
| Standard deviation | 67.24043 |
|---|---|
| Coefficient of variation (CV) | 0.42149104 |
| Kurtosis | -0.9584374 |
| Mean | 159.52992 |
| Median Absolute Deviation (MAD) | 68 |
| Skewness | -0.14742022 |
| Sum | 9571795 |
| Variance | 4521.2754 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 132 | 3669 | 6.1% |
| 48 | 2309 | 3.8% |
| 79 | 2143 | 3.6% |
| 237 | 1942 | 3.2% |
| 161 | 1927 | 3.2% |
| 186 | 1826 | 3.0% |
| 170 | 1781 | 3.0% |
| 142 | 1776 | 3.0% |
| 162 | 1770 | 2.9% |
| 239 | 1756 | 2.9% |
| Other values (202) | 39101 |
| Value | Count | Frequency (%) |
| 1 | 35 | 0.1% |
| 4 | 140 | 0.2% |
| 5 | 2 | < 0.1% |
| 6 | 1 | < 0.1% |
| 7 | 86 | 0.1% |
| 8 | 1 | < 0.1% |
| 10 | 33 | 0.1% |
| 11 | 1 | < 0.1% |
| 12 | 45 | 0.1% |
| 13 | 356 |
| Value | Count | Frequency (%) |
| 265 | 106 | 0.2% |
| 264 | 900 | |
| 263 | 1582 | |
| 262 | 708 | |
| 261 | 444 | 0.7% |
| 260 | 35 | 0.1% |
| 259 | 1 | < 0.1% |
| 258 | 5 | < 0.1% |
| 257 | 3 | < 0.1% |
| 256 | 78 | 0.1% |
dolocationid
Real number (ℝ)
| Distinct | 249 |
|---|---|
| Distinct (%) | 0.4% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 156.78078 |
| Minimum | 1 |
|---|---|
| Maximum | 265 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 37 |
| Q1 | 100 |
| median | 161 |
| Q3 | 233 |
| 95-th percentile | 262 |
| Maximum | 265 |
| Range | 264 |
| Interquartile range (IQR) | 133 |
Descriptive statistics
| Standard deviation | 74.06101 |
|---|---|
| Coefficient of variation (CV) | 0.47238576 |
| Kurtosis | -1.0492642 |
| Mean | 156.78078 |
| Median Absolute Deviation (MAD) | 71 |
| Skewness | -0.25046009 |
| Sum | 9406847 |
| Variance | 5485.0332 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 48 | 1826 | 3.0% |
| 236 | 1803 | 3.0% |
| 141 | 1765 | 2.9% |
| 170 | 1601 | 2.7% |
| 239 | 1590 | 2.6% |
| 263 | 1580 | 2.6% |
| 79 | 1524 | 2.5% |
| 161 | 1521 | 2.5% |
| 142 | 1460 | 2.4% |
| 237 | 1448 | 2.4% |
| Other values (239) | 43882 |
| Value | Count | Frequency (%) |
| 1 | 418 | |
| 2 | 3 | < 0.1% |
| 3 | 3 | < 0.1% |
| 4 | 300 | |
| 5 | 2 | < 0.1% |
| 6 | 3 | < 0.1% |
| 7 | 430 | |
| 8 | 1 | < 0.1% |
| 9 | 6 | < 0.1% |
| 10 | 85 | 0.1% |
| Value | Count | Frequency (%) |
| 265 | 488 | 0.8% |
| 264 | 545 | 0.9% |
| 263 | 1580 | |
| 262 | 1068 | |
| 261 | 392 | 0.7% |
| 260 | 96 | 0.2% |
| 259 | 16 | < 0.1% |
| 258 | 19 | < 0.1% |
| 257 | 39 | 0.1% |
| 256 | 173 | 0.3% |
payment_type
Categorical
| Distinct | 4 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 1 | |
|---|---|
| 2 | |
| 4 | 832 |
| 3 | 444 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 60000 |
|---|---|
| Distinct characters | 4 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2 |
|---|---|
| 2nd row | 1 |
| 3rd row | 1 |
| 4th row | 1 |
| 5th row | 1 |
Common Values
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
Most occurring characters
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 60000 |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 60000 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 60000 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 1 | 44549 | |
| 2 | 14175 | 23.6% |
| 4 | 832 | 1.4% |
| 3 | 444 | 0.7% |
fare_amount
Real number (ℝ)
| Distinct | 658 |
|---|---|
| Distinct (%) | 1.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 21.174815 |
| Minimum | -346 |
|---|---|
| Maximum | 454.5 |
| Zeros | 9 |
| Zeros (%) | < 0.1% |
| Negative | 608 |
| Negative (%) | 1.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | -346 |
|---|---|
| 5-th percentile | 5.8 |
| Q1 | 9.3 |
| median | 14.2 |
| Q3 | 25.4 |
| 95-th percentile | 70 |
| Maximum | 454.5 |
| Range | 800.5 |
| Interquartile range (IQR) | 16.1 |
Descriptive statistics
| Standard deviation | 20.738464 |
|---|---|
| Coefficient of variation (CV) | 0.97939294 |
| Kurtosis | 19.023514 |
| Mean | 21.174815 |
| Median Absolute Deviation (MAD) | 6.3 |
| Skewness | 2.3297621 |
| Sum | 1270488.9 |
| Variance | 430.0839 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 70 | 3080 | 5.1% |
| 8.6 | 2536 | 4.2% |
| 7.9 | 2470 | 4.1% |
| 10 | 2419 | 4.0% |
| 7.2 | 2394 | 4.0% |
| 9.3 | 2363 | 3.9% |
| 11.4 | 2200 | 3.7% |
| 10.7 | 2192 | 3.7% |
| 6.5 | 2190 | 3.6% |
| 12.1 | 1940 | 3.2% |
| Other values (648) | 36216 |
| Value | Count | Frequency (%) |
| -346 | 1 | |
| -270.32 | 1 | |
| -180 | 1 | |
| -161.2 | 1 | |
| -130 | 1 | |
| -105.9 | 1 | |
| -100.7 | 1 | |
| -100 | 2 | |
| -94 | 1 | |
| -90 | 1 |
| Value | Count | Frequency (%) |
| 454.5 | 1 | |
| 400 | 1 | |
| 346 | 1 | |
| 326.4 | 1 | |
| 296.3 | 1 | |
| 295.6 | 1 | |
| 272.5 | 1 | |
| 270.32 | 1 | |
| 267.6 | 1 | |
| 258 | 2 |
extra
Real number (ℝ)
HIGH CORRELATION ZEROS
| Distinct | 24 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.148344 |
| Minimum | -6 |
|---|---|
| Maximum | 9.75 |
| Zeros | 27569 |
| Zeros (%) | 45.9% |
| Negative | 233 |
| Negative (%) | 0.4% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | -6 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 1 |
| Q3 | 2.5 |
| 95-th percentile | 3.5 |
| Maximum | 9.75 |
| Range | 15.75 |
| Interquartile range (IQR) | 2.5 |
Descriptive statistics
| Standard deviation | 1.5048418 |
|---|---|
| Coefficient of variation (CV) | 1.3104451 |
| Kurtosis | 2.9345206 |
| Mean | 1.148344 |
| Median Absolute Deviation (MAD) | 1 |
| Skewness | 1.5589281 |
| Sum | 68900.64 |
| Variance | 2.2645488 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=24)
| Value | Count | Frequency (%) |
| 0 | 27569 | |
| 1 | 15925 | |
| 2.5 | 8190 | 13.7% |
| 3.5 | 4713 | 7.9% |
| 5 | 1948 | 3.2% |
| 3.75 | 319 | 0.5% |
| 1.25 | 301 | 0.5% |
| -1 | 217 | 0.4% |
| 8.75 | 208 | 0.3% |
| 6.25 | 191 | 0.3% |
| Other values (14) | 419 | 0.7% |
| Value | Count | Frequency (%) |
| -6 | 2 | < 0.1% |
| -5 | 11 | < 0.1% |
| -2.5 | 1 | < 0.1% |
| -1 | 217 | 0.4% |
| -0.5 | 2 | < 0.1% |
| 0 | 27569 | |
| 0.5 | 55 | 0.1% |
| 1 | 15925 | |
| 1.14 | 1 | < 0.1% |
| 1.25 | 301 | 0.5% |
| Value | Count | Frequency (%) |
| 9.75 | 3 | < 0.1% |
| 8.75 | 208 | 0.3% |
| 8.5 | 8 | < 0.1% |
| 7.5 | 127 | 0.2% |
| 7.25 | 13 | < 0.1% |
| 6.25 | 191 | 0.3% |
| 6 | 87 | 0.1% |
| 5 | 1948 | |
| 4.75 | 1 | < 0.1% |
| 3.75 | 319 | 0.5% |
mta_tax
Categorical
HIGH CORRELATION IMBALANCE
| Distinct | 4 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 0.5 | |
|---|---|
| 0.0 | 1179 |
| -0.5 | 574 |
| 0.8 | 14 |
Length
| Max length | 4 |
|---|---|
| Median length | 3 |
| Mean length | 3.0095667 |
| Min length | 3 |
Characters and Unicode
| Total characters | 180574 |
|---|---|
| Distinct characters | 5 |
| Distinct categories | 3 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0.5 |
|---|---|
| 2nd row | 0.5 |
| 3rd row | 0.5 |
| 4th row | 0.5 |
| 5th row | 0.5 |
Common Values
| Value | Count | Frequency (%) |
| 0.5 | 58233 | |
| 0.0 | 1179 | 2.0% |
| -0.5 | 574 | 1.0% |
| 0.8 | 14 | < 0.1% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 0.5 | 58807 | |
| 0.0 | 1179 | 2.0% |
| 0.8 | 14 | < 0.1% |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 61179 | |
| . | 60000 | |
| 5 | 58807 | |
| - | 574 | 0.3% |
| 8 | 14 | < 0.1% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 120000 | |
| Other Punctuation | 60000 | |
| Dash Punctuation | 574 | 0.3% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 61179 | |
| 5 | 58807 | |
| 8 | 14 | < 0.1% |
Other Punctuation
| Value | Count | Frequency (%) |
| . | 60000 |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 574 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 180574 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 61179 | |
| . | 60000 | |
| 5 | 58807 | |
| - | 574 | 0.3% |
| 8 | 14 | < 0.1% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 180574 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 61179 | |
| . | 60000 | |
| 5 | 58807 | |
| - | 574 | 0.3% |
| 8 | 14 | < 0.1% |
tip_amount
Real number (ℝ)
HIGH CORRELATION ZEROS
| Distinct | 1732 |
|---|---|
| Distinct (%) | 2.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 3.4642077 |
| Minimum | -0.9 |
|---|---|
| Maximum | 211.5 |
| Zeros | 18247 |
| Zeros (%) | 30.4% |
| Negative | 6 |
| Negative (%) | < 0.1% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | -0.9 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 2.52 |
| Q3 | 4.5125 |
| 95-th percentile | 12.45 |
| Maximum | 211.5 |
| Range | 212.4 |
| Interquartile range (IQR) | 4.5125 |
Descriptive statistics
| Standard deviation | 4.5117117 |
|---|---|
| Coefficient of variation (CV) | 1.3023791 |
| Kurtosis | 107.34285 |
| Mean | 3.4642077 |
| Median Absolute Deviation (MAD) | 2.52 |
| Skewness | 5.0946398 |
| Sum | 207852.46 |
| Variance | 20.355542 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 18247 | |
| 2 | 2462 | 4.1% |
| 1 | 2104 | 3.5% |
| 3 | 1335 | 2.2% |
| 5 | 1087 | 1.8% |
| 2.8 | 715 | 1.2% |
| 2.1 | 578 | 1.0% |
| 3.5 | 572 | 1.0% |
| 2.52 | 563 | 0.9% |
| 10 | 548 | 0.9% |
| Other values (1722) | 31789 |
| Value | Count | Frequency (%) |
| -0.9 | 1 | < 0.1% |
| -0.01 | 5 | < 0.1% |
| 0 | 18247 | |
| 0.01 | 82 | 0.1% |
| 0.02 | 16 | < 0.1% |
| 0.03 | 7 | < 0.1% |
| 0.04 | 2 | < 0.1% |
| 0.05 | 18 | < 0.1% |
| 0.06 | 4 | < 0.1% |
| 0.07 | 4 | < 0.1% |
| Value | Count | Frequency (%) |
| 211.5 | 1 | |
| 104 | 1 | |
| 99.99 | 1 | |
| 90 | 2 | |
| 85 | 1 | |
| 81 | 1 | |
| 80.55 | 1 | |
| 80 | 1 | |
| 77 | 1 | |
| 75 | 1 |
tolls_amount
Real number (ℝ)
HIGH CORRELATION ZEROS
| Distinct | 132 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.69923917 |
| Minimum | -20.75 |
|---|---|
| Maximum | 49.85 |
| Zeros | 54413 |
| Zeros (%) | 90.7% |
| Negative | 42 |
| Negative (%) | 0.1% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | -20.75 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 6.55 |
| Maximum | 49.85 |
| Range | 70.6 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 2.4697361 |
|---|---|
| Coefficient of variation (CV) | 3.5320334 |
| Kurtosis | 30.804007 |
| Mean | 0.69923917 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 4.5366338 |
| Sum | 41954.35 |
| Variance | 6.0995962 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 54413 | |
| 6.55 | 4792 | 8.0% |
| 13.75 | 163 | 0.3% |
| 11.75 | 160 | 0.3% |
| 3 | 42 | 0.1% |
| -6.55 | 31 | 0.1% |
| 19.75 | 25 | < 0.1% |
| 16.75 | 23 | < 0.1% |
| 13.1 | 21 | < 0.1% |
| 11.55 | 19 | < 0.1% |
| Other values (122) | 311 | 0.5% |
| Value | Count | Frequency (%) |
| -20.75 | 1 | < 0.1% |
| -19.75 | 1 | < 0.1% |
| -15.75 | 1 | < 0.1% |
| -13.75 | 4 | < 0.1% |
| -11.75 | 3 | < 0.1% |
| -8.36 | 1 | < 0.1% |
| -6.55 | 31 | 0.1% |
| 0 | 54413 | |
| 1 | 2 | < 0.1% |
| 2 | 1 | < 0.1% |
| Value | Count | Frequency (%) |
| 49.85 | 1 | |
| 39.75 | 1 | |
| 36.25 | 1 | |
| 34.05 | 2 | |
| 34 | 1 | |
| 33.8 | 1 | |
| 33.7 | 1 | |
| 32.1 | 1 | |
| 30 | 1 | |
| 29.65 | 1 |
improvement_surcharge
Categorical
HIGH CORRELATION IMBALANCE
| Distinct | 5 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 1.0 | |
|---|---|
| -1.0 | 606 |
| 0.3 | 171 |
| 0.0 | 11 |
| -0.3 | 2 |
Length
| Max length | 4 |
|---|---|
| Median length | 3 |
| Mean length | 3.0101333 |
| Min length | 3 |
Characters and Unicode
| Total characters | 180608 |
|---|---|
| Distinct characters | 5 |
| Distinct categories | 3 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 1.0 |
|---|---|
| 2nd row | 1.0 |
| 3rd row | 1.0 |
| 4th row | 1.0 |
| 5th row | 1.0 |
Common Values
| Value | Count | Frequency (%) |
| 1.0 | 59210 | |
| -1.0 | 606 | 1.0% |
| 0.3 | 171 | 0.3% |
| 0.0 | 11 | < 0.1% |
| -0.3 | 2 | < 0.1% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 1.0 | 59816 | |
| 0.3 | 173 | 0.3% |
| 0.0 | 11 | < 0.1% |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 60011 | |
| . | 60000 | |
| 1 | 59816 | |
| - | 608 | 0.3% |
| 3 | 173 | 0.1% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 120000 | |
| Other Punctuation | 60000 | |
| Dash Punctuation | 608 | 0.3% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 60011 | |
| 1 | 59816 | |
| 3 | 173 | 0.1% |
Other Punctuation
| Value | Count | Frequency (%) |
| . | 60000 |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 608 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 180608 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 60011 | |
| . | 60000 | |
| 1 | 59816 | |
| - | 608 | 0.3% |
| 3 | 173 | 0.1% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 180608 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 60011 | |
| . | 60000 | |
| 1 | 59816 | |
| - | 608 | 0.3% |
| 3 | 173 | 0.1% |
total_amount
Real number (ℝ)
| Distinct | 4296 |
|---|---|
| Distinct (%) | 7.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 29.667955 |
| Minimum | -351 |
|---|---|
| Maximum | 472.25 |
| Zeros | 2 |
| Zeros (%) | < 0.1% |
| Negative | 608 |
| Negative (%) | 1.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | -351 |
|---|---|
| 5-th percentile | 10.5 |
| Q1 | 15.25 |
| median | 21 |
| Q3 | 33.4 |
| 95-th percentile | 88.8 |
| Maximum | 472.25 |
| Range | 823.25 |
| Interquartile range (IQR) | 18.15 |
Descriptive statistics
| Standard deviation | 25.351152 |
|---|---|
| Coefficient of variation (CV) | 0.8544961 |
| Kurtosis | 12.939333 |
| Mean | 29.667955 |
| Median Absolute Deviation (MAD) | 7.2 |
| Skewness | 2.181676 |
| Sum | 1780077.3 |
| Variance | 642.6809 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 12.6 | 940 | 1.6% |
| 16.8 | 907 | 1.5% |
| 21 | 754 | 1.3% |
| 14 | 554 | 0.9% |
| 15.12 | 496 | 0.8% |
| 15.96 | 487 | 0.8% |
| 18.48 | 449 | 0.7% |
| 13.3 | 449 | 0.7% |
| 14.28 | 440 | 0.7% |
| 11.2 | 437 | 0.7% |
| Other values (4286) | 54087 |
| Value | Count | Frequency (%) |
| -351 | 1 | |
| -287.57 | 1 | |
| -166.2 | 1 | |
| -146.8 | 1 | |
| -145.25 | 1 | |
| -122.45 | 1 | |
| -111.75 | 1 | |
| -111.15 | 1 | |
| -105.35 | 1 | |
| -101 | 2 |
| Value | Count | Frequency (%) |
| 472.25 | 1 | |
| 401 | 1 | |
| 359.22 | 1 | |
| 351 | 1 | |
| 349.7 | 1 | |
| 338.16 | 1 | |
| 333.05 | 1 | |
| 300 | 1 | |
| 297.65 | 1 | |
| 297.07 | 1 |
congestion_surcharge
Categorical
HIGH CORRELATION IMBALANCE
| Distinct | 3 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 2.5 | |
|---|---|
| 0.0 | |
| -2.5 | 474 |
Length
| Max length | 4 |
|---|---|
| Median length | 3 |
| Mean length | 3.0079 |
| Min length | 3 |
Characters and Unicode
| Total characters | 180474 |
|---|---|
| Distinct characters | 5 |
| Distinct categories | 3 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2.5 |
|---|---|
| 2nd row | 2.5 |
| 3rd row | 2.5 |
| 4th row | 0.0 |
| 5th row | 2.5 |
Common Values
| Value | Count | Frequency (%) |
| 2.5 | 53185 | |
| 0.0 | 6341 | 10.6% |
| -2.5 | 474 | 0.8% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 2.5 | 53659 | |
| 0.0 | 6341 | 10.6% |
Most occurring characters
| Value | Count | Frequency (%) |
| . | 60000 | |
| 2 | 53659 | |
| 5 | 53659 | |
| 0 | 12682 | 7.0% |
| - | 474 | 0.3% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 120000 | |
| Other Punctuation | 60000 | |
| Dash Punctuation | 474 | 0.3% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 2 | 53659 | |
| 5 | 53659 | |
| 0 | 12682 | 10.6% |
Other Punctuation
| Value | Count | Frequency (%) |
| . | 60000 |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 474 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 180474 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| . | 60000 | |
| 2 | 53659 | |
| 5 | 53659 | |
| 0 | 12682 | 7.0% |
| - | 474 | 0.3% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 180474 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| . | 60000 | |
| 2 | 53659 | |
| 5 | 53659 | |
| 0 | 12682 | 7.0% |
| - | 474 | 0.3% |
airport_fee
Categorical
| Distinct | 3 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 468.9 KiB |
| 0.0 | |
|---|---|
| 1.25 | |
| -1.25 | 76 |
Length
| Max length | 5 |
|---|---|
| Median length | 3 |
| Mean length | 3.0968667 |
| Min length | 3 |
Characters and Unicode
| Total characters | 185812 |
|---|---|
| Distinct characters | 6 |
| Distinct categories | 3 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0.0 |
|---|---|
| 2nd row | 0.0 |
| 3rd row | 0.0 |
| 4th row | 1.25 |
| 5th row | 0.0 |
Common Values
| Value | Count | Frequency (%) |
| 0.0 | 54264 | |
| 1.25 | 5660 | 9.4% |
| -1.25 | 76 | 0.1% |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 0.0 | 54264 | |
| 1.25 | 5736 | 9.6% |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 108528 | |
| . | 60000 | |
| 1 | 5736 | 3.1% |
| 2 | 5736 | 3.1% |
| 5 | 5736 | 3.1% |
| - | 76 | < 0.1% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 125736 | |
| Other Punctuation | 60000 | |
| Dash Punctuation | 76 | < 0.1% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 108528 | |
| 1 | 5736 | 4.6% |
| 2 | 5736 | 4.6% |
| 5 | 5736 | 4.6% |
Other Punctuation
| Value | Count | Frequency (%) |
| . | 60000 |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 76 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 185812 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 108528 | |
| . | 60000 | |
| 1 | 5736 | 3.1% |
| 2 | 5736 | 3.1% |
| 5 | 5736 | 3.1% |
| - | 76 | < 0.1% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 185812 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 108528 | |
| . | 60000 | |
| 1 | 5736 | 3.1% |
| 2 | 5736 | 3.1% |
| 5 | 5736 | 3.1% |
| - | 76 | < 0.1% |
duration
Real number (ℝ)
HIGH CORRELATION SKEWED
| Distinct | 3574 |
|---|---|
| Distinct (%) | 6.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 17.260832 |
| Minimum | 0 |
|---|---|
| Maximum | 2596.6333 |
| Zeros | 24 |
| Zeros (%) | < 0.1% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 468.9 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 2.8333333 |
| Q1 | 6.9 |
| median | 11.9 |
| Q3 | 19.7 |
| 95-th percentile | 36.85 |
| Maximum | 2596.6333 |
| Range | 2596.6333 |
| Interquartile range (IQR) | 12.8 |
Descriptive statistics
| Standard deviation | 60.277089 |
|---|---|
| Coefficient of variation (CV) | 3.4921311 |
| Kurtosis | 621.9327 |
| Mean | 17.260832 |
| Median Absolute Deviation (MAD) | 5.8666667 |
| Skewness | 23.813387 |
| Sum | 1035649.9 |
| Variance | 3633.3274 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0.1 | 86 | 0.1% |
| 6.35 | 73 | 0.1% |
| 7.3 | 73 | 0.1% |
| 6.166666667 | 73 | 0.1% |
| 5.966666667 | 72 | 0.1% |
| 5.7 | 72 | 0.1% |
| 4.533333333 | 71 | 0.1% |
| 8.933333333 | 70 | 0.1% |
| 0.06666666667 | 70 | 0.1% |
| 6.483333333 | 68 | 0.1% |
| Other values (3564) | 59272 |
| Value | Count | Frequency (%) |
| 0 | 24 | < 0.1% |
| 0.01666666667 | 3 | < 0.1% |
| 0.03333333333 | 27 | < 0.1% |
| 0.05 | 42 | |
| 0.06666666667 | 70 | |
| 0.08333333333 | 63 | |
| 0.1 | 86 | |
| 0.1166666667 | 44 | |
| 0.1333333333 | 63 | |
| 0.15 | 41 |
| Value | Count | Frequency (%) |
| 2596.633333 | 2 | |
| 2596.2 | 1 | |
| 1439.016667 | 1 | |
| 1438.783333 | 1 | |
| 1438.6 | 1 | |
| 1438.45 | 1 | |
| 1438.383333 | 1 | |
| 1438.3 | 1 | |
| 1438.283333 | 1 | |
| 1438.25 | 1 |
| passenger_count | trip_distance | ratecodeid | pulocationid | dolocationid | fare_amount | extra | tip_amount | tolls_amount | total_amount | duration | vendorid | store_and_fwd_flag | payment_type | mta_tax | improvement_surcharge | congestion_surcharge | airport_fee | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| passenger_count | 1.000 | 0.045 | 0.081 | 0.003 | -0.006 | 0.068 | -0.040 | 0.021 | 0.063 | 0.068 | 0.067 | 0.254 | 0.073 | 0.037 | 0.049 | 0.012 | 0.026 | 0.022 |
| trip_distance | 0.045 | 1.000 | 0.285 | -0.117 | -0.102 | 0.883 | 0.090 | 0.375 | 0.443 | 0.870 | 0.844 | 0.040 | 0.000 | 0.007 | 0.114 | 0.011 | 0.193 | 0.386 |
| ratecodeid | 0.081 | 0.285 | 1.000 | -0.075 | -0.041 | 0.412 | -0.183 | 0.146 | 0.547 | 0.403 | 0.263 | 0.094 | 0.000 | 0.032 | 0.003 | 0.021 | 0.160 | 0.017 |
| pulocationid | 0.003 | -0.117 | -0.075 | 1.000 | 0.084 | -0.122 | -0.029 | -0.027 | -0.083 | -0.113 | -0.112 | 0.025 | 0.005 | 0.038 | 0.033 | 0.009 | 0.205 | 0.386 |
| dolocationid | -0.006 | -0.102 | -0.041 | 0.084 | 1.000 | -0.111 | -0.004 | -0.013 | -0.051 | -0.100 | -0.115 | 0.016 | 0.000 | 0.049 | 0.140 | 0.013 | 0.153 | 0.057 |
| fare_amount | 0.068 | 0.883 | 0.412 | -0.122 | -0.111 | 1.000 | 0.046 | 0.391 | 0.460 | 0.976 | 0.887 | 0.055 | 0.000 | 0.159 | 0.334 | 0.250 | 0.326 | 0.469 |
| extra | -0.040 | 0.090 | -0.183 | -0.029 | -0.004 | 0.046 | 1.000 | 0.093 | 0.053 | 0.089 | 0.067 | 0.872 | 0.097 | 0.092 | 0.130 | 0.093 | 0.170 | 0.330 |
| tip_amount | 0.021 | 0.375 | 0.146 | -0.027 | -0.013 | 0.391 | 0.093 | 1.000 | 0.237 | 0.527 | 0.346 | 0.015 | 0.023 | 0.026 | 0.146 | 0.000 | 0.085 | 0.049 |
| tolls_amount | 0.063 | 0.443 | 0.547 | -0.083 | -0.051 | 0.460 | 0.053 | 0.237 | 1.000 | 0.476 | 0.382 | 0.033 | 0.000 | 0.048 | 0.335 | 0.068 | 0.168 | 0.339 |
| total_amount | 0.068 | 0.870 | 0.403 | -0.113 | -0.100 | 0.976 | 0.089 | 0.527 | 0.476 | 1.000 | 0.864 | 0.062 | 0.000 | 0.205 | 0.380 | 0.307 | 0.389 | 0.497 |
| duration | 0.067 | 0.844 | 0.263 | -0.112 | -0.115 | 0.887 | 0.067 | 0.346 | 0.382 | 0.864 | 1.000 | 0.023 | 0.000 | 0.028 | 0.013 | 0.019 | 0.016 | 0.047 |
| vendorid | 0.254 | 0.040 | 0.094 | 0.025 | 0.016 | 0.055 | 0.872 | 0.015 | 0.033 | 0.062 | 0.023 | 1.000 | 0.109 | 0.065 | 0.065 | 0.062 | 0.052 | 0.047 |
| store_and_fwd_flag | 0.073 | 0.000 | 0.000 | 0.005 | 0.000 | 0.000 | 0.097 | 0.023 | 0.000 | 0.000 | 0.000 | 0.109 | 1.000 | 0.023 | 0.001 | 0.033 | 0.003 | 0.000 |
| payment_type | 0.037 | 0.007 | 0.032 | 0.038 | 0.049 | 0.159 | 0.092 | 0.026 | 0.048 | 0.205 | 0.028 | 0.065 | 0.023 | 1.000 | 0.311 | 0.320 | 0.359 | 0.130 |
| mta_tax | 0.049 | 0.114 | 0.003 | 0.033 | 0.140 | 0.334 | 0.130 | 0.146 | 0.335 | 0.380 | 0.013 | 0.065 | 0.001 | 0.311 | 1.000 | 0.587 | 0.666 | 0.247 |
| improvement_surcharge | 0.012 | 0.011 | 0.021 | 0.009 | 0.013 | 0.250 | 0.093 | 0.000 | 0.068 | 0.307 | 0.019 | 0.062 | 0.033 | 0.320 | 0.587 | 1.000 | 0.626 | 0.250 |
| congestion_surcharge | 0.026 | 0.193 | 0.160 | 0.205 | 0.153 | 0.326 | 0.170 | 0.085 | 0.168 | 0.389 | 0.016 | 0.052 | 0.003 | 0.359 | 0.666 | 0.626 | 1.000 | 0.316 |
| airport_fee | 0.022 | 0.386 | 0.017 | 0.386 | 0.057 | 0.469 | 0.330 | 0.049 | 0.339 | 0.497 | 0.047 | 0.047 | 0.000 | 0.130 | 0.247 | 0.250 | 0.316 | 1.000 |
A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
| vendorid | passenger_count | trip_distance | ratecodeid | store_and_fwd_flag | pulocationid | dolocationid | payment_type | fare_amount | extra | mta_tax | tip_amount | tolls_amount | improvement_surcharge | total_amount | congestion_surcharge | airport_fee | duration | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 2 | 1.0 | 0.97 | 1.0 | N | 161 | 141 | 2 | 9.3 | 1.00 | 0.5 | 0.00 | 0.0 | 1.0 | 14.30 | 2.5 | 0.00 | 8.433333 |
| 1 | 2 | 1.0 | 1.10 | 1.0 | N | 43 | 237 | 1 | 7.9 | 1.00 | 0.5 | 4.00 | 0.0 | 1.0 | 16.90 | 2.5 | 0.00 | 6.316667 |
| 2 | 2 | 1.0 | 2.51 | 1.0 | N | 48 | 238 | 1 | 14.9 | 1.00 | 0.5 | 15.00 | 0.0 | 1.0 | 34.90 | 2.5 | 0.00 | 12.750000 |
| 3 | 1 | 0.0 | 1.90 | 1.0 | N | 138 | 7 | 1 | 12.1 | 7.25 | 0.5 | 0.00 | 0.0 | 1.0 | 20.85 | 0.0 | 1.25 | 9.616667 |
| 4 | 2 | 1.0 | 1.43 | 1.0 | N | 107 | 79 | 1 | 11.4 | 1.00 | 0.5 | 3.28 | 0.0 | 1.0 | 19.68 | 2.5 | 0.00 | 10.833333 |
| 5 | 2 | 1.0 | 1.84 | 1.0 | N | 161 | 137 | 1 | 12.8 | 1.00 | 0.5 | 10.00 | 0.0 | 1.0 | 27.80 | 2.5 | 0.00 | 12.300000 |
| 6 | 2 | 1.0 | 1.66 | 1.0 | N | 239 | 143 | 1 | 12.1 | 1.00 | 0.5 | 3.42 | 0.0 | 1.0 | 20.52 | 2.5 | 0.00 | 10.450000 |
| 7 | 2 | 1.0 | 11.70 | 1.0 | N | 142 | 200 | 1 | 45.7 | 1.00 | 0.5 | 10.74 | 3.0 | 1.0 | 64.44 | 2.5 | 0.00 | 22.733333 |
| 8 | 2 | 1.0 | 2.95 | 1.0 | N | 164 | 236 | 1 | 17.7 | 1.00 | 0.5 | 5.68 | 0.0 | 1.0 | 28.38 | 2.5 | 0.00 | 14.933333 |
| 9 | 2 | 1.0 | 3.01 | 1.0 | N | 141 | 107 | 2 | 14.9 | 1.00 | 0.5 | 0.00 | 0.0 | 1.0 | 19.90 | 2.5 | 0.00 | 10.900000 |
| vendorid | passenger_count | trip_distance | ratecodeid | store_and_fwd_flag | pulocationid | dolocationid | payment_type | fare_amount | extra | mta_tax | tip_amount | tolls_amount | improvement_surcharge | total_amount | congestion_surcharge | airport_fee | duration | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 59990 | 2 | 1.0 | 1.55 | 1.0 | N | 68 | 230 | 2 | 27.5 | 0.0 | 0.5 | 0.00 | 0.0 | 1.0 | 31.50 | 2.5 | 0.0 | 36.050000 |
| 59991 | 1 | 2.0 | 1.50 | 1.0 | N | 249 | 79 | 1 | 10.7 | 2.5 | 0.5 | 1.47 | 0.0 | 1.0 | 16.17 | 2.5 | 0.0 | 11.066667 |
| 59992 | 1 | 1.0 | 0.50 | 1.0 | N | 68 | 264 | 2 | 5.1 | 2.5 | 0.5 | 0.00 | 0.0 | 1.0 | 9.10 | 2.5 | 0.0 | 2.500000 |
| 59993 | 1 | 3.0 | 1.00 | 1.0 | N | 107 | 264 | 1 | 7.2 | 2.5 | 0.5 | 2.20 | 0.0 | 1.0 | 13.40 | 2.5 | 0.0 | 4.950000 |
| 59994 | 1 | 2.0 | 1.90 | 1.0 | N | 234 | 48 | 2 | 19.1 | 2.5 | 0.5 | 0.00 | 0.0 | 1.0 | 23.10 | 2.5 | 0.0 | 27.666667 |
| 59995 | 1 | 2.0 | 6.30 | 1.0 | N | 48 | 255 | 1 | 30.3 | 3.5 | 0.5 | 7.05 | 0.0 | 1.0 | 42.35 | 2.5 | 0.0 | 29.966667 |
| 59996 | 1 | 1.0 | 1.00 | 1.0 | N | 237 | 142 | 1 | 7.9 | 2.5 | 0.5 | 2.00 | 0.0 | 1.0 | 13.90 | 2.5 | 0.0 | 6.666667 |
| 59997 | 1 | 1.0 | 2.00 | 1.0 | N | 142 | 233 | 1 | 12.8 | 2.5 | 0.5 | 4.20 | 0.0 | 1.0 | 21.00 | 2.5 | 0.0 | 14.066667 |
| 59998 | 1 | 1.0 | 0.90 | 1.0 | N | 263 | 262 | 1 | 7.2 | 2.5 | 0.5 | 2.25 | 0.0 | 1.0 | 13.45 | 2.5 | 0.0 | 5.983333 |
| 59999 | 1 | 1.0 | 1.80 | 1.0 | N | 140 | 142 | 1 | 11.4 | 2.5 | 0.5 | 3.10 | 0.0 | 1.0 | 18.50 | 2.5 | 0.0 | 11.566667 |
Most frequently occurring
| vendorid | passenger_count | trip_distance | ratecodeid | store_and_fwd_flag | pulocationid | dolocationid | payment_type | fare_amount | extra | mta_tax | tip_amount | tolls_amount | improvement_surcharge | total_amount | congestion_surcharge | airport_fee | duration | # duplicates | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 1 | 1.0 | 0.0 | 1.0 | N | 48 | 264 | 2 | 3.0 | 2.5 | 0.5 | 0.0 | 0.0 | 1.0 | 7.00 | 2.5 | 0.00 | 0.000000 | 4 |
| 1 | 1 | 1.0 | 0.0 | 1.0 | N | 239 | 264 | 2 | 3.0 | 2.5 | 0.5 | 0.0 | 0.0 | 1.0 | 7.00 | 2.5 | 0.00 | 0.000000 | 2 |
| 2 | 2 | 1.0 | 0.0 | 1.0 | N | 132 | 132 | 2 | 3.0 | 0.0 | 0.5 | 0.0 | 0.0 | 1.0 | 5.75 | 0.0 | 1.25 | 0.066667 | 2 |
| 3 | 2 | 1.0 | 0.0 | 5.0 | N | 265 | 265 | 1 | 50.0 | 0.0 | 0.0 | 10.2 | 0.0 | 1.0 | 61.20 | 0.0 | 0.00 | 0.100000 | 2 |
| 4 | 2 | 1.0 | 0.7 | 1.0 | N | 79 | 79 | 1 | 6.5 | 1.0 | 0.5 | 2.3 | 0.0 | 1.0 | 13.80 | 2.5 | 0.00 | 4.666667 | 2 |
| 5 | 2 | 2.0 | 0.0 | 5.0 | N | 265 | 265 | 1 | 120.0 | 0.0 | 0.0 | 24.2 | 0.0 | 1.0 | 145.20 | 0.0 | 0.00 | 0.133333 | 2 |
| 6 | 2 | 3.0 | 0.0 | 1.0 | N | 132 | 132 | 2 | 3.0 | 0.0 | 0.5 | 0.0 | 0.0 | 1.0 | 5.75 | 0.0 | 1.25 | 0.133333 | 2 |